AMNet: Memorability Estimation with Attention

In this paper we present the design and evaluation of an end-to-end trainable, deep neural network with a visual attention mechanism for memorability estimation in still images. We analyze the suitability of transfer learning of deep models from image classification to the memorability task. Further on we study the impact of the attention mechanism on the memorability estimation and evaluate our network on the SUN Memorability and the LaMem datasets. Our network outperforms the existing state of the art models on both datasets in terms of the Spearman's rank correlation as well as the mean squared error, closely matching human consistency

Improving the Segmentation Stage of a Pedestrian Tracking Video-based System by means of Evolution Strategies

12 pages, 7 figures.-- Contributed to: Eighth European Workshop on Evolutionary Computation in Image Analysis and Signal Processing (EvoIASP 2006, Budapest, Hungary, Apr 10-12, 2006).Pedestrian tracking video-based systems present particular problems such as the multi fragmentation or low level of compactness of the resultant blobs due to the human shape or movements. This paper shows how to improve the segmentation stage of a video surveillance system by adding morphological post-processing operations so that the subsequent blocks increase their performance. The adjustment of the parameters that regulate the new morphological processes is tuned by means of Evolution Strategies. Finally, the paper proposes a group of metrics to assess the global performance of the surveillance system. After the evaluation over a high number of video sequences, the results show that the shape of the tracks match up more accurately with the parts of interests. Thus, the improvement of segmentation stage facilitates the subsequent stages so that global performance of the surveillance system increases.Funded by CICYT (TIC2002-04491-C02-02)Publicad

Robotic Monitoring of Habitats: the Natural Intelligence Approach

In this paper, we first discuss the challenges related to habitat monitoring and review possible robotic solutions. Then, we propose a framework to perform terrestrial habitat monitoring exploiting the mobility of legged robotic systems. The idea is to provide the robot with the Natural Intelligence introduced as the combination of the environment in which it moves, the intelligence embedded in the design of its body, and the algorithms composing its mind. This approach aims to solve the challenges of deploying robots in real natural environments, such as irregular and rough terrains, long-lasting operations, and unexpected collisions, with the final objective of assisting humans in assessing the habitat conservation status. Finally, we present examples of robotic monitoring of habitats in four different environments: forests, grasslands, dunes, and screes

Bio-inspired relevant interaction modelling in cognitive crowd management

Cognitive algorithms, integrated in intelligent systems, represent an important innovation in designing interactive smart environments. More in details, Cognitive Systems have important applications in anomaly detection and management in advanced video surveillance. These algorithms mainly address the problem of modelling interactions and behaviours among the main entities in a scene. A bio-inspired structure is here proposed, which is able to encode and synthesize signals, not only for the description of single entities behaviours, but also for modelling cause–effect relationships between user actions and changes in environment configurations. Such models are stored within a memory (Autobiographical Memory) during a learning phase. Here the system operates an effective knowledge transfer from a human operator towards an automatic systems called Cognitive Surveillance Node (CSN), which is part of a complex cognitive JDL-based and bio-inspired architecture. After such a knowledge-transfer phase, learned representations can be used, at different levels, either to support human decisions, by detecting anomalous interaction models and thus compensating for human shortcomings, or, in an automatic decision scenario, to identify anomalous patterns and choose the best strategy to preserve stability of the entire system. Results are presented in a video surveillance scenario , where the CSN can observe two interacting entities consisting in a simulated crowd and a human operator. These can interact within a visual 3D simulator, where crowd behaviour is modelled by means of Social Forces. The way anomalies are detected and consequently handled is demonstrated, on synthetic and also on real video sequences, in both the user-support and automatic modes

Ethnic disparities in progression rates for sight-threatening diabetic retinopathy in diabetic eye screening: a population-based retrospective cohort study

INTRODUCTION: The English Diabetic Eye Screening Programme (DESP) offers people living with diabetes (PLD) annual eye screening. We examined incidence and determinants of sight-threatening diabetic retinopathy (STDR) in a sociodemographically diverse multi-ethnic population. RESEARCH DESIGN AND METHODS: North East London DESP cohort data (January 2012 to December 2021) with 137 591 PLD with no retinopathy, or non-STDR at baseline in one/both eyes, were used to calculate STDR incidence rates by sociodemographic factors, diabetes type, and duration. HR from Cox models examined associations with STDR. RESULTS: There were 16 388 incident STDR cases over a median of 5.4 years (IQR 2.8-8.2; STDR rate 2.214, 95% CI 2.214 to 2.215 per 100 person-years). People with no retinopathy at baseline had a lower risk of sight-threatening diabetic retinopathy (STDR) compared with those with non-STDR in one eye (HR 3.03, 95% CI 2.91 to 3.15, p<0.001) and both eyes (HR 7.88, 95% CI 7.59 to 8.18, p<0.001). Black and South Asian individuals had higher STDR hazards than white individuals (HR 1.57, 95% CI 1.50 to 1.64 and HR 1.36, 95% CI 1.31 to 1.42, respectively). Additionally, every 5-year increase in age at inclusion was associated with an 8% reduction in STDR hazards (p<0.001). CONCLUSIONS: Ethnic disparities exist in a health system limited by capacity rather than patient economic circumstances. Diabetic retinopathy at first screen is a strong determinant of STDR development. By using basic demographic characteristics, screening programmes or clinical practices can stratify risk for sight-threatening diabetic retinopathy development

Ethnic disparities in progression rates for sight-threatening diabetic retinopathy in diabetic eye screening: a population-based retrospective cohort study.

INTRODUCTION: The English Diabetic Eye Screening Programme (DESP) offers people living with diabetes (PLD) annual eye screening. We examined incidence and determinants of sight-threatening diabetic retinopathy (STDR) in a sociodemographically diverse multi-ethnic population. RESEARCH DESIGN AND METHODS: North East London DESP cohort data (January 2012 to December 2021) with 137 591 PLD with no retinopathy, or non-STDR at baseline in one/both eyes, were used to calculate STDR incidence rates by sociodemographic factors, diabetes type, and duration. HR from Cox models examined associations with STDR. RESULTS: There were 16 388 incident STDR cases over a median of 5.4 years (IQR 2.8-8.2; STDR rate 2.214, 95% CI 2.214 to 2.215 per 100 person-years). People with no retinopathy at baseline had a lower risk of sight-threatening diabetic retinopathy (STDR) compared with those with non-STDR in one eye (HR 3.03, 95% CI 2.91 to 3.15, p<0.001) and both eyes (HR 7.88, 95% CI 7.59 to 8.18, p<0.001). Black and South Asian individuals had higher STDR hazards than white individuals (HR 1.57, 95% CI 1.50 to 1.64 and HR 1.36, 95% CI 1.31 to 1.42, respectively). Additionally, every 5-year increase in age at inclusion was associated with an 8% reduction in STDR hazards (p<0.001). CONCLUSIONS: Ethnic disparities exist in a health system limited by capacity rather than patient economic circumstances. Diabetic retinopathy at first screen is a strong determinant of STDR development. By using basic demographic characteristics, screening programmes or clinical practices can stratify risk for sight-threatening diabetic retinopathy development

Ambient intelligence: a new multidisciplinary paradigm

Ambient intelligence (AmI) is a new multidisciplinary paradigm rooted in the ideas of Norman(1) and Ubiquitous Computing. AmI fosters novel anthropomorphic human-machine models of interaction. In AmI, technologies are deployed to make computers disappear in the background, while the human user moves into the foreground in complete control of the augmented environment. AmI is a user-centric paradigm, it supports a variety of artificial intelligence methods and works pervasively, nonintrusively, and transparently to aid the user. AmI supports and promotes interdisciplinary research encompassing the technological, scientific and artistic fields creating a virtual support for embedded and distributed intelligence